Toward data-driven solutions to interactive dynamic influence diagrams
نویسندگان
چکیده
Abstract With the availability of significant amount data, data-driven decision making becomes an alternative way for solving complex multiagent problems. Instead using domain knowledge to explicitly build models, approach learns decisions (probably optimal ones) from available data. This removes bottleneck in traditional knowledge-driven making, which requires a strong support experts. In this paper, we study context interactive dynamic influence diagrams (I-DIDs)—a general framework sequential under uncertainty. We propose solve I-DIDs model and focus on learning behavior other agents problem domains. The challenge is complete policy tree that will be embedded models due limited two new methods develop trees I-DIDs. first method uses simple clustering process, while second one employs sophisticated statistical checks. analyze proposed algorithms theoretical experiment them over
منابع مشابه
Approximate Solutions of Interactive Dynamic Influence Diagrams Using Model Clustering
Interactive dynamic influence diagrams (I-DIDs) offer a transparent and semantically clear representation for the sequential decision-making problem over multiple time steps in the presence of other interacting agents. Solving I-DIDs exactly involves knowing the solutions of possible models of the other agents, which increase exponentially with the number of time steps. We present a method of s...
متن کاملSpeeding Up Solutions of Interactive Dynamic Influence Diagrams Using Action Equivalence
Interactive dynamic influence diagrams (I-DIDs) are graphical models for sequential decision making in partially observable settings shared by other agents. Algorithms for solving I-DIDs face the challenge of an exponentially growing space of candidate models ascribed to other agents, over time. Previous approach for exactly solving IDIDs groups together models having similar solutions into beh...
متن کاملSpeeding Up Exact Solutions of Interactive Dynamic Influence Diagrams Using Action Equivalence
Interactive dynamic influence diagrams (I-DIDs) are graphical models for sequential decision making in partially observable settings shared by other agents. Algorithms for solving I-DIDs face the challenge of an exponentially growing space of candidate models ascribed to other agents, over time. Previous approach for exactly solving IDIDs groups together models having similar solutions into beh...
متن کاملApproximate solutions of interactive dynamic influence diagrams using ε-behavioral equivalence
Interactive dynamic influence diagrams (I-DID) are graphical models for sequential decision making in uncertain settings shared by other agents. Algorithms for solving I-DIDs face the challenge of an exponentially growing space of candidate models ascribed to other agents, over time. Pruning the behaviorally equivalent models is one way toward identifying a minimal model set. We seek to further...
متن کاملǫ-Subjective Equivalence of Models for Interactive Dynamic Influence Diagrams
Interactive dynamic influence diagrams (I-DID) are graphical models for sequential decision making in uncertain settings shared by other agents. Algorithms for solving I-DIDs face the challenge of an exponentially growing space of candidate models ascribed to other agents, over time. Pruning behaviorally equivalent models is one way toward minimizing the model set. We seek to further reduce the...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Knowledge and Information Systems
سال: 2021
ISSN: ['0219-3116', '0219-1377']
DOI: https://doi.org/10.1007/s10115-021-01600-5